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We investigate the classical Renyi entropy S n and the associated mutual information T n in the Sherrington- 
Kirkpatrick (S-K) model, which is the paradigm model of mean-field spin glasses. Using classical Monte Carlo 
simulations and analytical tools we investigate the S-K model on the n-sheets booklet. This is obtained by gluing 
together n independent copies of the model, and it is the main ingredient to construct the Renyi entanglement- 
related quantities. We find a glassy phase at low temperature, whereas at high temperature the model exhibits 
paramagnetic behavior, consistent with the regular S-K model. The temperature of the paramagnetic-glassy 
transition depends non-trivially on the geometry of the booklet. At high-temperatures we provide the exact so¬ 
lution of the model by exploiting the replica symmetry. This is the permutation symmetry among the fictitious 
replicas that are used to perform disorder averages (via the replica trick). In the glassy phase the replica symme¬ 
try has to be broken. Using a generalization of the Parisi solution, we provide analytical results for S n and I n , 
and for standard thermodynamic quantities. Both S„ and I n exhibit a volume law in the whole phase diagram. 

We characterize the behavior of the corresponding densities S n /N,T n /N, in the thermodynamic limit. Inter¬ 
estingly, at the critical point the mutual information does not exhibit any crossing for different system sizes, in 
contrast with local spin models. 


I. INTRODUCTION 

Besides being ubiquitous in nature, disorder leads to sev¬ 
eral intriguing physical phenomena. Arguably, spin glasses 
represent one of the most prototypical examples of interest¬ 
ing behavior induced by disorder. While at any finite tem¬ 
perature disorder can prevent the usual magnetic ordering, at 
low-enough temperatures these systems display a new type of 
“order”. In the past decades an intense theoretical effort has 
been devoted to characterizing this spin glass order, the nature 
of the paramagnetic-glassy transition, and that of the associ¬ 
ated order parameter 1 

All these issues can be thoroughly addressed in the 
Sherrington-Kirkpatrick (S-K) model 6,7 , which is exactly 
solvable. The S-K model is a classical Ising model on the 
fully-connected graph of N sites, with quenched random in¬ 
teractions. Its hamiltonian reads 

n = - J ij s i s i~ h X (D 

l<i<j<N 1 <i<N 

Here Si = ±1 are classical Ising spins, h is an external mag¬ 
netic field, and Ji 3 are uncorrelated (from site to site) ran¬ 
dom variables. The S-K model hosts a low-temperature glassy 
phase, which is separated from a high-temperature param¬ 
agnetic one by a second order phase transition. Despite its 
mean-field nature, the solution of the S-K model has been 
a mathematical challenge. Although it was proposed as an 
ansatz by Parisi 6 more than thirty years ago, its rigorous proof 
was obtained only recently 9 . Moreover, the solution exhibits 
several intricate features, such as lack of self-averaging 10 , ul- 
trametricity 1 I I2 , and replica symmetry breaking 2,5 . The last 
refers to the breaking of the permutation symmetry among the 
fictitious replicas of the model, which are introduced to per¬ 
form disorder averages (via the so-called replica trick 13 . Fi¬ 
nally, although the applicability of the S-K model to describe 
realistic spin glasses is still highly debated 14 ~ 16 , there are re¬ 


cent proposals on how to realize it in cold-atomic gases 17,18 , 
or in laser systems 19 . 

In the last decade entanglement-related quantities emerged 
as valuable tools to understand the physics of complex sys- 
tems 20 ~ 23 , both classical and quantum. For instance, at a 
conformally invariant critical point entanglement measures 
contain universal information about the underlying conformal 
field theory (CFT), such as the central charge 24 27 . For clas¬ 
sical spin models a lot of attention has been focused on the 
classical Renyi entropy 28,29 . Given a bipartition of the system 
into two complementary subregions A and B, the classical 
Renyi entropy S n (A) (with n £ N) is defined as 

s - ( a s nb ‘os ( £ O ® 

l A £Ca 

Here Ca denotes the set of all the possible spin configurations 
in part A, whereas p iA is the probability of the configuration 
%A- Alternatively, S n (A) can be obtained from the partition 
function of the model on an ad hoc defined “booklet” geom¬ 
etry (see section II for its definition). This consists of n in¬ 
dependent and identical copies (the booklet “sheets”) of the 
model. These physical copies are different from the fictitious 
replicas used to perform the disorder average. Each sheet is 
divided into two parts A and B, containing Na and N n spins, 
respectively. The spins in part A of different sheets are con¬ 
strained to be equal. It is convenient to introduce the booklet 
aspect ratio 0 < ui < 1 as 


For local spin models the bipartition correspond to a spatial 
separation between the spins. However, the definition (2) can 
be used in models with no notion of space, where it quantifies 
the correlation between two groups of spins rathen than two 
spatial regions. Notice that Eq. (2) can also be used for quan¬ 
tum systems by replacing the sum over the proababilities of 
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proximation. In section VI we check the validity of both the 
RS and the 1-RSB results comparing with Monte Carlo sim¬ 
ulations for the internal energy. Section VII and section VIII 
discuss the classical Renyi entropy and the mutual informa¬ 
tion, respectively. We conclude in section IX. 


II. THE BOOKLET CONSTRUCTION & AND THE 
CLASSICAL RENYI ENTROPY 


FIG. 1. The booklet geometry considered in this work, (a) The 
single sheet (“page”) of the booklet: The N spins living on the sheet 
are divided into two groups A and B, containing Na and Nb spins, 
respectively. Here ui = Na/N is the booklet ratio, (b) The n sheets 
are glued together to form the booklet. The spins in part B of the 
booklet pages are at inverse temperature /3. The spins in part A are 
identified (see Eq. (8)). As a consequence, the effective temperature 
in part A is n/3. Z(lo, n, /3) denotes the partition function of the S-K 
model on the booklet. 


each state in region A with the trace over the reduced density 
matrix for region A. For n = 1 Eq. (2) defines the subsystem 
Shannon entropy 30,31 . From S n (A), one defines the classical 
mutual information X„(A, B) as 

Zn(A, B ) = S n (A) + S n (B) - S n (A U B). (4) 

For local models I n obeys the area law 32 X„(A) oc £, with £ 
the length of the boundary between A and B. Remarkably, for 
different l, the ratio I n /£ has been shown to exhibit a cross¬ 
ing at a second order phase transition 28 , implying that it can 
be used as a diagnostic tool for critical behaviors. For con¬ 
formally invariant critical models more universal information 
can be extracted from the area-law corrections of X„ 29 . 

Although recently the study of the interplay between dis¬ 
order and entanglement became a fruitful research area 33 , the 
behavior of entanglement-related quantities in glassy phases, 
and at glassy critical points, has not been explored yet (see, 
however. Ref. 34 for some interesting results). Here we inves¬ 
tigate both the classical Renyi entropy 5„(A) and the mutual 
information X„ in the S-K model, using classical Monte Carlo 
simulations and analytical tools. We often restrict ourselves 
to the case with n = 2, as this is where numerical simulations 
are most efficient. As usual in disordered system, we focus on 
disorder-averaged quantities, considering [/?„] and [X„], with 
the brackets [•] denoting the average over different realizations 
of Jij (cf. Eq. (1)). 

The Article is organized as follows. In section II we intro¬ 
duce the classical Renyi entropy and the mutual information, 
reviewing their representation in terms of the booklet parti¬ 
tion functions. In section III we present the structure of the 
solution of the S-K model on the booklet. Specifically, we 
discuss the replica trick, which is used to perform disorder 
averages, and the saddle point approximation in the thermo¬ 
dynamic limit. Section IV is concerned with the RS approxi¬ 
mation. In subsection IV A we focus on the high-temperature 
region, where this approximation becomes exact. In subsec¬ 
tion IV C we discuss the structure of the RS ansatz in the low- 
temperature region. Section V is devoted to the 1-RSB ap¬ 


Given a generic classical spin model at inverse temperature 
/3, The probability p, of a given spin configuration i £ C, with 
C being the set of all possible configurations, is given by the 
Boltzmann weight pi = e~^ E ^IZ , with E(i) the associated 
energy. In presence of a bipartition (see Fig. 1 (a)) the prob¬ 
ability of a spin configuration i a £ Ca is given as p iA = 
Y^i B e~P E< ' lA ’ lB ' > /Z, where the sum is over all possible spin 
configurations in part B. Note that this is valid for generic 
interactions, i.e., both local and non-local ones. Clearly, one 
has i™) e~P^ k e £ ia ' 1 b). Thus, the classi¬ 

cal Renyi entropy S n (A) (Eq. (2)) can be calculated as 28,29 


S n (A) = 


1 

1 — n 


log 


/ Z(A,n,f3) \ 

\ Z”(J3) I' 


(5) 


Here Z(A, n, /3) = ^2 iA ( 4 i i*) e ^ XT e 3aa%) ca n be in¬ 
terpreted as the partition function of the model on the n-sheet 
booklet (with k labelling its different sheets), whereas Z(3) is 
the partition functions on the plane at inverse temperatures 3. 
The booklet geometry is illustrated in Fig. 1, and consists of 
n identical copies (“sheets”) of the system. Each sheet is di¬ 
vided into two parts A and B (cf. Fig. 1 (a)). The spins in part 
A of the different sheets are identified (cf. Fig. 1 (b)). While 
spins in parts B of the booklet are at inverse temperature /3, 
the ones in A are at the effective temperature n/3. Notice that 
a similar geometric construction plays an important role in 
the mathematical proof of the Parisi ansatz. Moreover, the 
study of the partition function of critical models on the book¬ 
let has attracted considerable attention recently ’ 0 ^’. Clearly, 
one has S n (A) = l/(n-l)(log(X(A,n,/3))-nlog(F(/?))), 
where F(A,n,t 3) = log(Z(A,n/3)) and X(/3) = log(Z(/3)) 
are related (apart from a factor —1//3) to the free energy of the 
model on the booklet and on the plane, respectively. 

The mutual information X ra (A,33,/3) is obtained in terms 
of the booklet partition functions using Eq. (5) and Eq. (4), 
where S n (B ) is obtained from (5) by exchanging A and B. 
Notice also that in (5) Z(A U 33,n,/3) = Z(n3) is the par¬ 
tition function of the model on the booklet with all the n 
sheets identified, equivalently on a single sheet but at temper¬ 
ature n/3. Notice that the disorder-averaged mutual informa¬ 
tion [X„] and the Renyi entropy [,S'„] are directly related to the 
so-called quenched-averaged free energy \F(A. n, /3)], which 
is the main quantity of interest in disordered systems 13 . For 
clean (i.e., without disorder) local spin models X„ obeys the 
boundary law 


X n {A 1 33, 3) — Ot n £ + Gn + 7 ni 


( 6 ) 
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with l the length of the boundary between A and B, and 
a n , 7 „ two non-universal constants. Here Q n is the so-called 
geometric mutual information 29 . Interestingly, for critical sys¬ 
tems Q n depends only on the geometry of A and B, and it 
is universal. For conformally invariant models Q n can be 
calculated using standard methods of conformal field theory 
(CFT), and it allows to numerically extract universal informa¬ 
tion about the CFT, such as the central charge 29 . 


III. THE SHERRINGTON-KIRKPATRICK (S-K) MODEL 
ON THE BOO KL ET 


Here we introduce the Sherrington-Kirkpatrick (S-K) 
model on the booklet. In subsection III A we define the model 
and its partition function. In subsection IIIB we discuss the 
replicated booklet construction that is used to calculate the 
disorder-averaged free energy [F(u>, n, j3)\. In section HIC 
we consider the thermodynamic limit, using the saddle point 
approximation. We also introduce the overlap tensor, which 
contains all the information about the thermodynamic behav¬ 
ior of the model. The analytical formula for the replicated 
partition function (Eq. (19)), and the saddle point equations 
(Eqs. (22)(23)) for the overlap tensor are the main results of 
this section. 


A. The model and its partition function 

The Sherrington-Kirkpatrick (S-K) model 97 on the n- 
sheets booklet (cf. Fig. 1) is defined by the Hamiltonian 

n ( n ') 

« = -£ £ JiM r) s$ r) h £sf \ . (?) 

r=l [i<j t= 1 J 

Here = ±1 are classical Ising spins, r £ [l,n] labels 
the different sheets (“pages”) of the booklet, i £ [1, AT] de¬ 
notes the sites on each sheet, .J Kj is the interaction strength, 
and h is an external magnetic field. The total number of spins 
in the booklet is nN. The first sum inside the brackets in 
Eq. (7) is over all the N(N —1)/2 pairs of spins in each sheet. 
Spins on different sheets do not interact. In each “sheet” all 
the sites are divided into two groups A = {1,..., Na} and 
B = {Na + 1,.. •, N}, containing Na and Nb = N — Na 
sites, respectively. The spins living in part A and different 
sheets are identified, i.e. one has 

s (r) =s (r') vieA,r,r'. (8) 

Since in each sheet all spins interact with each other, there is 
no notion of distance between different spins. Thus, physi¬ 
cal observables should depend on the booklet geometry only 
through the ratio u> (cf. Eq. (3)). 

In Eq. (7) the couplings .l, :) £ R are uncorrelated (from site 
to site) quenched random variables. J,j are the same in all the 
sheets of the booklet. Specifically, here J, ;/ are drawn from 


the gaussian distribution 



The mean and the variance of P{{Jij}) are given as [,/,,] = 
Jq/N and — [Jr,-]) 2 ] = J 2 /N, respectively. Here we set 
J = 1. The square brackets [■] denote the average over differ¬ 
ent realizations of Jy. Here we restrict ourselves to Jo = 0 
and J = 1. The factors N in Eq. (9) ensure a well-defined 
thermodynamic limit. 

The partition function Z(u>,n, 0,{J}) of the S-K model on 
the booklet at inverse temperature (3 = 1/T, and for fixed 
disorder realization reads 

Z(u, n, f3, {J}) = Tr' exp(—/3T-L) = 

N 

Tr' exp {/3£ ( £ - h £ S< r) ) }, (10) 

r i<j i —1 

where Tr' = } denotes the sum over all possible spin 

configurations. The prime in Tr' stresses that only spin config¬ 
urations satisfying the constraint in Eq. (8) are considered. In 
the two limits ui = 0 and ui = 1 one recovers the standard S-K 
model. In particular, for u> = 0, i.e., n disconnected sheets, 
one has Z(0, n, f3, {J}) = ZQ3, {J}) n , with Z(f3, {J}) the 
partition function of the S-K model on the plane (i.e., the 
original S-K model). On the other hand, for uj = 1 it is 
Z(l, n, /3, {J}) = Z(n/3, { J}), i.e., the partition function of 
the S-K model at inverse temperature nf3. The quenched av¬ 
eraged free energy [.F(w, n, /?)], is defined as 

= J V{J}logZ(u>,n,/3,{J}), (11) 

where / V{J} = n, <y ./£ dJ l3 P{J l:j ). 

At (jj = 0 and u> = 1 the phase diagram of the S-K model in 
the thermodynamic limit is well established 2 - 4 . At oj = 0 it ex¬ 
hibits a standard paramagnetic phase in the high temperature 
region, whereas at low temperatures a glassy phase is present, 
with replica-symmetry breaking. The two phases are divided 
by a second order phase transition at j3 = j3 c = 1. The phase 
diagram for uj = 1 is the same, apart from the trivial rescal¬ 
ing fj -a n/3. We anticipate here (see section IV C) that a 
similar scenario holds for generic w. Specifically, the glassy 
replica-symmetry-broken phase at low temperatures survives 
for generic 0 < w < 1, while at high enough temperature the 
model is paramagnetic. The critical point, which marks the 
transition between the two phases, is a nontrivial function of 
the booklet ratio uj (see section IV D). 


B. The replicated booklet and the overlap tensor 


The disorder-averaged free energy [F(ui,n, j3)} (cf. 
Eq. (11)) of the model is obtained, using the standard replica 
trick 13 , as 


[F(u),n,f3)\ = lim 

a —>-0 


[Z a (w,n,P)]~ 1 


( 12 ) 
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Here [Z a (uj : n, ft)} is the disorder-averaged partition function 
of a € N independent copies of the S-K model on the booklet. 
Precisely, [Z a (u>, n, ft)} reads 

[Z a (u,n,ft)\ = f V{J} Tr'exp^l 

** r, 7 

ft £ +fthJ2 sl r ^ }, (13) 

i<j i 

where the index 7 = 1 , 2,..., a labels the different fictitious 
replicas introduced in Eq. (12), whereas r denote the physical 
copies, i.e., the booklet sheets, as in Eq. (10). Again, spins 
on different sheets or different replicas do not interact with 
each other. Notice that Z a (uj , n, ft) can be thought of as the 
partition function of the S-K model on a “replicated” booklet. 

Using Eq. (9), the disorder average in Eq. (13) can be per¬ 
formed explicitly, to obtain 


[Z a (w,n,ft)\ = Tr'exp^] | 

r, 7 

— ^ ^ Sr r ' , ' yl ' > S 

i<j 7 / ,r / 

+ {}J 0 S™S™) +fth'£S?rt}. (14) 


Interestingly, L r describes a system of ria spins living in the 
replica space with the long-range interaction g//,, and a mag¬ 
netic field 771 / + h. Notice that, while the first term in Eq. (17) 
is off-diagonal in the space of the fictitious replicas, the sec¬ 
ond one is diagonal. We anticipate here that the latter fully de¬ 
termines the behavior of the model in the paramagnetic phase 
(see section IV A). 

Since in Eq. (15) spins on different sites are decoupled, one 
can perform the trace over the spins in parts A and B (see 
Fig. 1) independently, to obtain 

[z a (u,n,ft)\ = ( n d( i7y j n^-pM 

7<7 r 7? r 

r,r' 

^ + u\ogTv A e c + (1 - u) \ogTv B e c - Kj |. (18) 

Here to lighten the notation we drop the dependence on the 
coordinate i and the arguments of £,({g, to}) and IC({q, to}). 
Ti' /i and Tr b denote the trace over the spin degrees of freedom 
living in parts A and B of the booklet. The subscript A in 
Tr i is to stress that spins living in different sheets (i.e., for 
r r' in Eq. (17)) are identified (due to the booklet constraint 
in Eq. (8)), whereas they have to be treated as independent 
variables in performing Trg. 


In contrast with Eq. (13), both different sheets and different 
replicas are now coupled by a four-spin interaction. It is con¬ 
venient to introduce the Hubbard-Stratonovich variables gift, 

r\ I 

and ?n/. Following the spin glass literature-, we dub qlL, the 
overlap tensor. In the standard S-K model (i.e., for n = 1) 
g/L becomes a a x a matrix 7 . Eq. (14) now yields 

[Z a (u;,n,ft)\ = exp N ^ na ^j f dqfy 

7 < 7 ' 7 ,r 

r,r' 

Tv' exp | - NlC({q,m}) + ^ A({g, to})}, (15) 

i 

where we neglected subleading contributions 0(1/IV) in the 
thermodynamic limit. Here IC({q, to}) is spin-independent 
and it reads 

«({<!,»>}) = (EE(tf)’ 

7 < 7 ' r,r f 

+EEic')’) + /-EK) a - 06) 

ry r<ir' 

On the other hand Cft{q, to}) depends on the spin degrees of 
freedom, and it is given as 

£,({,. m () 

7<7' r,r' 

ft 2 E E <7 sf’ 7) ^ (r ' 7) + ft Ek + ^ (r,7) - w 

7 r<jr' 7 r 


C. The saddle point approximation 

In the thermodynamic limit, i.e., for N, Na —► 00 , at fixed 
ratio u) = Na/N, one can take the saddle point approximation 
in Eq. (18), which yields 

[Z a (uj,n,ft)\ « exp|7Va( — - — 

+ - log Tv a exp(£) + -(1 - u) logTr s exp(£)) }. (19) 
a a J J 

The overlap tensor g//, and to/ are determined by solving the 
saddle point equations 

(w log Tv A e c + (1 - w) log Tr s e £ ) = g/y (20) 

oq yi i 

(u\ogTv A e c + (1 -w)logTr B e £ ) = J^to/. (21) 

It is enlightening to rewrite Eqs. (20) (21) as 

g"', = coiS^S^'^A + (1 - w)(S (r ’ 7) S' (r '- 7 ' ) ) B (22) 
J 0 “H = a >(S^) A + (1 - u)(S^) B (23) 

where ( 0) A (b ) = (^A(B)) _1 Tr A(B) {0 exp(£)} with 

Za(b) = Tr^(s) exp(£). Notice that Eq. (22) implies that 
g/Z = 1 V 7 , r. For uj = 0 and n = 1, one recovers the saddle 
point equations for the standard SK model 2 ’ 4 . 

In order to calculate the free energy [F(w, n. ft)} one has to 
solve Eqs. (22) (23), take the analytic continuation a £ R, 
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and, finally, the limit a —> 0. (cf. Eq. (12)). Although 
it is possible to solve Eqs. (22) (23) numerically for any 
fixed r, a £ N, taking the analytic continuation a £ 1 is a 
formidable task, since the dependence of Z a (u>, n, j3) on a is 
in general too complicated. The strategy is usually to choose 
a specific form of the overlap tensor q^L, in terms of “few” 
parameters, which allows to perform the analytic continuation 
and the limit a —»• 0 exactly. 

For the standard S-K model (i.e., for n = 1) the simplest 
parametrization is the replica-symmetric one (RS), which 
amounts to taking q 4 L = q. This relies on the observation 
that the fictitious replicas appear symmetrically in Eq. (13). 
Although the RS ansatz is correct at high temperatures, it fails 
in the glassy phase at low temperatures, where the permuta¬ 
tion invariance within the replicas has to be broken 44 . The cel¬ 
ebrated Parisi ansatz 45 provides a systematic scheme to break 
the replica symmetry in successive steps, and it allows to cap¬ 
ture the glassy behavior of the S-K model at low tempera¬ 
ture. We anticipate (see section V for the details) that a similar 
scheme has to be used to describe the glassy phase of the S-K 
model on the booklet. 


IV. THE REPLICA-SYMMETRIC (RS) ANSATZ 

In this section we present the solution of the S-K model 
on the booklet, using the replica symmetric (RS) approxima¬ 
tion. In subsection IV A we focus on the high temperature 
phase, where this approximation is exact, and the behavior of 
the model is fully determined by the diagonal part of the over¬ 
lap tensor qX,, (see section IIIB for its definition). In IV B 
we perform the analytic continuation n —> 1 , which allows 
to obtain the Shannon mutual information [Xi], The generic 
structure of qlL, within the RS ansatz is discussed in subsec¬ 
tion IV C. This allows us to determine the critical temperature 
of the paramagnetic-glassy transition. For simplicity, here and 
in the following sections we restrict ourselves to zero mag¬ 
netic field (h = 0 in Eq. (7)), and to Jq = 0 in Eq. (9). 


A. The paramagnetic phase 

Here we provide the exact analytical expression for the 
disorder-averaged free energy [F para (u>, n, f$)\ in the para¬ 
magnetic non-glassy phase. We start discussing the infi¬ 
nite temperature limit (i.e., /3 —► 0), restricting ourselves 
to zero magnetic field. Using Eq. (17), a standard high- 
temperature expansion yields Tr a& C = 2 a + 0(/3 2 ) and 
Trse £ = 2 na + 0(/ 3 2 ), implying 

(S^S^'^b = 2 na 6 7t yS r y + OQ 3 2 ) (24) 

(S^S^’^A = 2 “(S 7i7 / + e>(/? 2 ). (25) 

Using Eq. (22), it is straightforward to obtain the infinite- 
temperature overlap tensor g", as 

= (1 — u)5 in ’5 r y + u}S J: -y>. (26) 



FIG. 2. The S-K model on the 2-sheets booklet in the paramagnetic 
phase: the solution qo of the saddle point equation (34) plotted as 
a function of the booklet aspect ratio u> and several values of the 
inverse temperature /3 = 1 /T. At w = 1 one has qo = 1, V/3. In the 
zero-temperature limit one has qo —» l,Vw. The straight line is the 
infinite temperature result. 

/ , . . it 

Notice that qlf, is diagonal in both the indices 7,7 and r, r , 
i.e., the sheet and the replica spaces. Using Eq. (19) and 
Eq. (12), after performing the analytic continuation a —> 0, 
one obtains 

[Fpara(w,n, /3)] = iv|(n - ui(n - 1)) log( 2 ) 

+ ^(uj 2 (n 2 - n) + n)^ + (27) 

It is natural to expect that for finite /3 < f} c , with /3 C the critical 
temperature of the paramagnetic-glassy transition, the overlap 
tensor q”’, remains diagonal. This suggests the ansatz 

q!yy = (1 - qo)5 r ,r'&i,y + 70 ^ 7 , 7 '• (28) 

with go £ Ra parameter. The ansatz (28) is formally obtained 
from Eq. (26) by replacing w —► go- Notice that one has qlL = 
1, in agreement with Eqs. (22). Using Eq. (28), one obtains 
para (cf. Eq. (17)) as 

Cpara = 0 2 f { £ £ ^ - 7W*} . (29) 

7 rr' 

After introducing the Hubbard-Stratonovich variables z\ 
(with A = 1,..., a), one can write 

Tr n ex])(C parn ) — 

Trs f Yi D z\exp (z A ^ v / go^S' (r ’ A) ), (30) 

■'A r 

where f Dzf(z) = (27r) -1 / 2 f exp(— z 2 /2)f(z). Notice 
that due to the square root in Eq. (30), one has the constraint 
go > 0. Moreover, from Eq. (29) one obtains 'Ii' i exp(£) = 
2 nc> . The trace IV/j in Eq. (30) can be performed explic¬ 
itly. Using Eq. (19) and Eq. (12), one obtains the free energy 
\Fpara{y)■> tt, f3)\ US 
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FIG. 3. The S-K model on the 2-sheets booklet. The overlap tensor 
in the replica-symmetric (RS) approximation (see Eq. (37)): the so¬ 
lutions qo and q' 0 (shown as full and dotted lines, respectively) of the 
saddle point equations (A1)(A2) plotted as a function of the book¬ 
let aspect ratio oj, and inverse temperature /? = 1/T = 1,3/2, 2. 
At uj = 1 one has that qo = 1,V/J. In the limit p —> oo it is 
7o, 9o ~^ 1, Vcu. 


[Fparaiu, n, P)\ = N |n log(2) - oj(n - 1) log(2) 

+ y(f uq 0 n 2 - q 0 nj 

+ (1 — uj) log J Dzcosh n (z y /qoP)'^, (31) 

where qo is determined by solving the saddle point condition 
d[F para (oj,n,P)]/dqo = 0. [F para (oj,n, p)} can be written 
in terms of simple functions using that 


jDzoo^(z^) = 


2 

+ 


\n/2\ — l 

1 T(7l + 1) 

i-l Z_^ 


o 2/3 2 q 0 (n/2-k) 2 


T(k + l)r(n - k + 1) 

_„2/3 2 q 0 (n/2-Ln/2j) 2 


fc =0 

2 -2Ln/2j r ( n + i) 


T(n- \_n/2\ + l)r([n/2j +1) 


(32) 


where T(a;) denotes the Euler Gamma function. The saddle 
point equation for qo reads 


0 = P(ojn — 1 — qo(n — 1)) 

/ Dz cosh "" 1 (Zy/chP) sinh ( Zy /q^f3)z 

Vvo I Dz cosh ” ( z V<ioP) 

For the 2-sheets booklet (i.e., n = 2) this is given as 

q 0 = oj + (1 - uj) tanh(/3 2 g 0 )- (34) 

Alternatively, Eq. (34) can be obtained by substituting the 
ansatz (28) in Eqs. (22) (23). Clearly, for two independent 
copies of the S-K model, i.e., uj = 0, Eq. (34) gives q 0 = 0 for 
p < 1 , whereas one has qo / 0 for p > 1. On the other hand, 


for oj = 1 one has qo = 1 V/3. For intermediate 0 < uj < 1, qo 
is plotted as a function of oj in Fig. 2. For ft = 0 it is qo = oj 
(straight line in the Figure). In the low-temperature limit one 
has qo -A 1, for any oj. In particular, it is straightforward to 
check that q 0 ~ 1 — 2(1 — oj) exp(—2/3 2 ) for p —> oo. 


B. The analytic continuation n —> 1 


It is interesting to consider the analytic continuation 
limn-*.!]/;,,,] and lim„_,.i[I„] to obtain the Shannon entropy 
and mutual information. In the limit n —> 1, F para (oj, n, 0) 
(see (31)) does not depend on qo and oj, as expected. This 
holds for any P even including the effects of the replica sym¬ 
metry breaking. However, the Shannon entropy S'i(A) (and 
the mutual information T\ thereof) is non trivial due to the 
prefactor 1/(1 — n) in (5). In order to obtain S\ (A) one should 
consider 1/(1 — n)[F para (oj, n, P)\ performing carefully the 
limit n — > 1. The result reads 


[Fparaifd, 1, P)] . . . P /Qq . , \ 

N( 1 - n) =^og(2) + Y ( Y n-ojq 0 (n+l)+ qo ) 

f Dzcosh(zy/qEP)\ogcosh(z^/ctoP) 
- jD~z cosh(^) -’ <35) 

The saddle point equation (33) for qo now becomes 


(oj-q 0 )exp(p 2 q ^)+(l-uj) J Dz(j^=smh(zy/%P) 

— cosh(zy/qoP)^J log cosh(z^qop) = 0. (36) 

Notice that in the limit P —>■ 0 one has qo —> oj, which im¬ 
plies, using (35) and (4), the volume-law behavior [2/] —► 
p 2 /2 oj(1 — oj)N. This in constrast with the clean case 46 , 
where = 0(1) for any P away from the critical point at 

Pc = I- 


C. The replica-symmetric (RS) approximation 

In the replica-symmetric (RS) approximation one writes the 
overlap tensor qPL, as 


qfy = (1 - qo)5 r yS 1 ,y + g 0 ^ 7 , 7 ' + (1 - <5 7 , 7 ')5o- (37) 

The first two terms in Eq. (37) are the same as in the para¬ 
magnetic phase (cf. Eq. (28)). The last term sets q™, = q' 0 
V 7 7 ^ j' and Vr, r'. Clearly, qPP, is invariant under permu¬ 
tations of both the booklet sheets and the replicas. We do 
not have any rigorous argument to justify the ansatz (37), be¬ 
sides its simplicity. However, we numerically observe that it 
captures quite accurately the behavior of the model, at least 
around the paramagnetic-glassy transition (see section VI for 
the comparison with Monte Carlo data). 

Using Eq. (37) and Eqs. (1 2)( 19) one obtains the replica- 
symmetric approximation for the free energy [Frs(oj, n, p)\ 
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as 


[FRs(u,nJ 3 )] = 


lim 

a —>-0 




((?o - Wo) 2 )n 2 



+ ~—— log Tyb exp (Crs) 
a 

+ ^logTr A exp(£ fl s)j (38) 

where Crs is obtained by substituting Eq. (37) in Eq. (17), 
which yields 


C RS = ij-p 2 E S (r ’ 7) S (r '’ y) 

^ ii 

77 rr 

+ ^P 2 J2 E - ^p 2 na. (39) 


7 rr' 


To calculate the last two terms in Eq. (38) one has to introduce 
two auxiliary Hubbard-Stratonovich variables z, zf, similar to 
the paramagnetic phase (cf. section IV A). Thus, after per¬ 
forming the trace over the spin variables, in the limit a —> 0, 
one obtains 

logTr B exp(C R s) = - y/3 2 rca + nalog(2) (40) 

+ a J Dz log J Dz'H^ s (z,z'), 
log Tp4 exp(£ flS ) = - y p 2 na + a log(2) (41) 

+ a Dz log / Dz'HRs{nz,nz'), 


where H RS (z, z') = cosh(pz^/(^ + Pz'^/q 0 - q' 0 ). No¬ 
tice that because of the square roots in the definition of 
Hrs(z, z '), one has the constraint 0 < q' 0 < qo < 1. 

In Eqs. (40)(41) qo,q' 0 satisfy the saddle point condi¬ 
tions d[F R s{u,n/p)\/dq 0 = d[F RS {u,n, P)]/dq' 0 = 0 (cf. 
Eqs. (A1)(A2) for their form for n = 2). The resulting go 
and g ( '| are plotted in Fig. 3 (full and dotted lines, respectively) 
as function of uj and for several values of p. Clearly, for any 
P one has go = 1 in the limit uj —> 1. Also, in the zero- 
temperature limit P — > oo one has that go —> 1 and q' 0 —>• 1, 
for any uj. Moreover, a simple large P expansion yields 


Qo = 1 
<7o = l 



(42) 

(43) 


with the dots denoting exponentially suppressed terms in the 
limit p —> oo. Interestingly, from Eq. (42) one has that go —> 1 
exponentially in the limit P —> oo, as in the paramagnetic 
phase (cf. section IV A), whereas q' 0 — 1 oc 1//3. 


D. The paramagnetic-glassy transition 



FIG. 4. The critical temperature p c = l/T c of the paramagnetic- 
glassy Uansition for the S-K model on the 2-sheets booklet (see 
Fig. 1) from Eq. (44): /3 C as a function of the booklet ratio uj = 
Na/N. Here /3 C is obtained from the replica-symmetric (RS) ap¬ 
proximation. Notice that /3 C = 1 and /3 C = 1/2 for uj = 0 and 
uj = 1, respectively. 


transition. Near the glassy transition one should expect q' 0 —► 
0, whereas q 0 should remain finite (see section IV A). One ex¬ 
pands n, P)] (cf. Eq (38)) for small qg, keeping only 

terms up to O({q' 0 ) 2 ). Thus, P c is obtained by imposing that 
the coefficient of the quadratic term q'p vanishes. This leads 
to the equation 

1 — 4 B 2 

exp(-4g 0 /3 2 ) + 2 exp(-2q 0 /3 2 ) = — -(44) 

4 p& -1 

where g 0 is obtained by solving the high-temperature saddle 
point equation (34). The resulting P c is plotted in Fig. 4 as a 
function of uj. 


V. THE ONE-STEP REPLICA-SYMMETRY-BREAKING 
(1-RSB) APPROXIMATION 

In this section we go beyond the replica-symmetric approx¬ 
imation, including some of the effects of the replica symme¬ 
try breaking. More specifically, here we discuss the one-step 
replica symmetry breaking (1-RSB) approximation. The over¬ 
lap tensor q ", now reads 

^77 / — (f do)^7,7 / ^r,r / “F ^0^7,7' “F (1 ^ 7 , 7 ; )7 3 ( 45 ) 

which is formally equivalent to the RS ansatz in Eq. (37), apart 
from the trivial redefinition q' 0 —>• q'. However, in contrast 
with Eq. (37), where q' 0 G Risa number, here q' is a matrix. 
Inspired by the Parisi scheme for the standard S-K model 45 , 
we choose 

f q[ if b/mi\ = W/rm] 
q' = \ (46) 

I qg otherwise 


Using the replica-symmetric ansatz Eq. (37) one can deter¬ 
mine the critical temperature P c of the paramagnetic-glassy 


where q' 0 ,q[ € R, rrii £ N, and |_-J denotes the floor function. 
Notice that the off-diagonal elements of q' (i.e., for 7 / 7 ') 
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P 


FIG. 5. The S-K model on the 2-sheets booklet with aspect ratio u> = 
1/2 (see Fig. 1): The internal energy per spin U/N as a function of 
the inverse temperature /?. The triangles, squares, and rhombi, denote 
the Monte Carlo data for a booklet with N = 32, 64,128 spins per 
sheet. Notice that the Monte Carlo error bars are often smaller than 
the symbol sizes. The plus symbols are the extrapolations to the 
thermodynamic limit N — > oo, at fixed cj. The dash-dotted line is 
the analytical result Urs/N obtained using the replica-symmetric 
(RS) approximation. The horizontal dotted line is the exact zero- 
temperature result U/N = 2uoo, with {too ~ —0.76321 the zero 
temperature energy density of the regular S-K model 41 ' 4 '. 


do not depend on r, A, meaning that, although the permuta¬ 
tion symmetry between the replicas is broken, the symmetry 
among the booklet sheets is preserved. The choice in Eq. (46) 
corresponds to a simple block-diagonal structure for q'\ the 


matrix elements of the mi x m\ diagonal blocks of q' are set 
to (j\ , whereas all the off-diagonal elements are set to q' 0 . As 
for the replica-symmetric ansatz in Eq. (37), we do not have 
any rigorous argument to justify Eq. (46) (see section (VI), 
however, for numerical results). 

The effective interaction £i-rsb (cf. Eq. (17)) in the 
replica space is obtained by substituting Eq. (45) in Eq. (17). 
This yields 


a ./mi 


r / o2 ‘iu 

£i -RSB/P — ——na—~ 


E E (E s0v ”)' 


( 7—1 76 B& r 


% 

2 


( J2 5' (r ’ 7) 


2 nL — 




! ot/m 


E ( E s< 

< 7=1 1 &B a ,r 


r,l) 


(47) 


where we defined B a = [ami, (a + 1)toi) with a £ N. 

It is convenient to introduce the Hubbard-Stratonovich vari¬ 
ables z,z a ,z a ^ (one for each term in Eq. (47)). One then 
obtains 

log Tr' exp (Ci-rsb) = - 7 ^ A 2 na 
+ log Tr' f Dz n/ Dz a f DZ(j^ Gxp ^ 

^ o ^ jeB a J r 

+ z a, 1 \ /( io -q'i + ZcrVq'i - Vo) s{r,1) }• ( 48 ) 

The trace over the spin variables in Eq. (48) can be now per¬ 
formed explicitly. Finally, one obtains the 1-RSB approxima¬ 
tion for the free energy [Fi.rsb{u, n, /3)\ as 


[Fi-RSB(u,n&)]/N = (w + (1 - w)n) log(2) + j/3 2 (l + nq’^ - n(mi - l)(qj 2 - q’ 0 2 ) - (n - l)g 2 - 2g 0 ) 

+ J Dz | log J Dz | J Dz"Hi_ rsb (z,z’ ,z")} -t-^log j Dz'j J Dz"Hi_ RSB (nz,nd ,nz")} |, (49) 


where we defined Hi.rsb(z, z', z") as 

Hi- RS b{z,z' ,z") = cosh (^/ 3 v / ^ 

+ z/’ Ps/q 0 - q[ + z'/?\Ai -q' 0 ). (50) 

Similar to the replica-symmetric situation (see section IV C), 
from Eq. (50) one has the constraint 0 < q' 0 < q[ < qo < 1. 
The parameters qo, q' 0 , q[, mi are obtained by solving the sad¬ 
dle point equations (A7)(A8)(A9) (A10). One should re¬ 
mark that, although mi is by defintion an integer, one obtains 
mi £ R from the saddle point equations. Clearly, the replica- 
symmetric result [F R s(co,n,/3)\ (cf. Eq. (38)) is recovered 
from Eq. (49) in the limit q\ = q' 0 , while the free energy in 
the paramagnetic phase [F para (co, n, /?)] (cf. Eq. (31)) corre¬ 
sponds to q[ = q'o = 0. 


VI. MONTE CARLO RESULTS: THE INTERNAL 
ENERGY 


In this section we numerically confirm the analytical results 
of section IV. We discuss Monte Carlo (MC) data for the S- 
K model on the 2-sheets booklet with zero external magnetic 
field. The data we present are obtained from parallel temper¬ 
ing Monte Carlo simulations 48 . In the parallel tempering sim¬ 
ulations N le p identical disorder realizations of the system are 
simulated. Each copy is at a different temperature in the range 
/3min — An ax ■ The standard Metropolis sweeps at each temper¬ 
ature are supplemented with parallel tempering moves, which 
allow to exchange the spin configurations between replicas 
with neighboring temperatures. In our simulations we choose 
the interval with /3 m i n = 0.25 and /3 max = 2.5, with 46 tem- 
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peratures corresponding to equally spaced values of 0 Each 
Monte Carlo sweep consists of N single spin updates and 45 
parallel tempering moves. For each disorder realization we 
perform 10 5 sweeps. The disorder average is performed over 
128 different disorder realizations. 

We focus on the internal energy U (w, n, 0) 

U(u,n,j3) = -J^[log(Z(w,n,/?))]. (51) 

Fig. 5 plots the MC data for U (w, 2, 0) versus the inverse tem¬ 
perature j3, for uj = 1/2. The circles, squares, and triangles 
are the MC results for different sizes, i.e., number of spins per 
sheet, N = 32,64,128. The vertical dotted line is the crit¬ 
ical temperature /3 C ~ 0.6 of the paramagnetic-glassy tran¬ 
sition (cf. Fig. 4). In the high-temperature region finite-size 
effects are small, and already for N = 64 the MC data are 
indistinguishable from the thermodynamic limit result. Op¬ 
positely, stronger scaling corrections are visible in the low- 
temperature phase at /3 > f3 c . The plus symbols in Fig. 5 
are the numerical extrapolations in the thermodynamic limit. 
These are obtained by fitting the finite size MC data to the 
ansatz U/N = Uoo(ui, 0)+c/N^, where u 00 is energy density 
in the thermodynamic limit, c a fitting parameter, and 0 the ex¬ 
ponent of the scaling corrections. In our fits we fix 0 = 2/3, 
which is the exponent governing the finite-size corrections of 
U/N in the standard S-K model 49,50 . 

The dash-dotted line in Fig. 5 is the analytical result Urs 
obtained using the replica-symmetric (RS) approximation (see 
section IV C). Using Eq. (38) and Eq. (51), Urs is obtained 
as 

Urs = -Np(l + q 2 -2q' 2 ). (52) 

Here qo,q'o are solutions of the saddle point equations 
Eqs. (Al) (A2). Notice that Urs depends on uj only through 
qo,q' 0 . From Fig. 5 one has that, while Urs is in perfect 
agreement with the numerics for /? « 0 C , deviations appear 
in the low-temperature region. Notice that already at j3 > 1, 
Urs is incompatible with the data. These deviations increase 
upon lowering the temperature and have to be attributed to 
the replica symmetry breaking happening in the glassy phase. 
Finally, since in the limit /3 —) oo all the sheets are in the 
same state, one should expect that Uoo(uj,f3) —) nuoo (hori¬ 
zontal line in Fig. 5), with = —0.76321... 45,47 the zero- 
temperature internal energy density of the S-K model on the 
plane. 

The behavior of U/N for different ui is investigated in 
Fig. 6, plotting U/N as a function of 3 and for u> = 
0,1/4,3/4,1. The result for ui = 1/2 is shown for com¬ 
parison. The plus symbols are the MC data extrapolated to 
the thermodynamic, at fixed oj. Similar to Fig. 6, the extrap¬ 
olations are done assuming U/N(ui, n, 3) = Uoo(ijj,n, f3) + 
c/N^ , with 0 = 2/3 irrespective of uj. The stars in Fig. 6 are 
the critical values U c /N at the paramagnetic-glassy transition, 
whereas the lines are the analytical results (cf. Eq. (52)). No¬ 
tice that at high temperature, and for generic n and uj, Eq. (27) 
and Eq. (51) give 

U RS = -N^(co 2 (n 2 -n)+n)+O0 3 2 ), (53) 



P 


FIG. 6. The S-K model on the 2-sheets booklet: The internal en¬ 
ergy per spin U/N in the thermodynamic limit. The symbols are the 
Monte Carlo data extrapolated to the thermodynamic limit N —» oo, 
at fixed booklet ratio lo (see Fig. 1). U/N is plotted as a function 
of inverse temperature /3 and for uj = 0,1/4,1/2, 3/4,1. The lines 
are the analytical results Urs obtained using the replica-symmetric 
(RS) approximation. The stars denote the value of U c /N at the 
paramagnetic-glassy transition. 



P 


FIG. 7. The S-K model on the 2-sheets booklet: The internal energy 
per spin U/N in the thermodynamic limit plotted as a function of 
inverse temperature /3. The plus symbols are the same extrapolated 
Monte Carlo data as in Fig. 6. The lines denote U/N in the replica- 
symmetric (RS) approximation (same as in Fig. 6). The circles are 
the results in the one-step replica symmetry breaking (1-RSB) ap¬ 
proximation. 


i.e., a linear behavior of U/N as a function of 0 For uj = 0 
and u) = 1 this behavior is exact up to the critical point at 
P = /3 C , meaning that the higher orders O{0 2 ) in Eq. (53) 
are zero. This is only an approximation at intermediate 0 < 
ui < 1. Both the behaviors in Eq. (52) and Eq. (53) are clearly 
confirmed in Fig. 6. 

However, from Fig. 6 one has that the RS result is not cor¬ 
rect for /3 > 3c, where the replica symmetry breaking has 
to be taken into account. This is more carefully discussed in 
Fig. 7, focusing on the low temperature region at 1 < < 2. 

The plus symbols and the lines are the same as in Fig. 6. The 
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FIG. 8. The classical disorder-averaged Renyi entropy per spin [S 2 (oj)]/N in the S-K model on the 2-sheets booklet: [S 2 (w)] /N as a function 
of the inverse temperature /3. The different panels correspond to different booklet aspect ratios u> = 3/4,1/2,1/4 (see Fig. 1). The triangles, 
squares and rhombi denote the Monte Carlo results for booklets with N = 32,64,128 spins per sheet. The Monte Carlo error bars are often 
smaller than the symbol size. The plus symbols are the numerical extrapolations to the thermodynamic limit. The inset in panel (a) shows 
[S 2 ]/(V at fixed j3 = 2, plotted versus N ~ 2 ^ 3 .The dotted line is a linear fit. In all the panels the dash-dotted lines are the analytical results 
in the replica-symmetry (RS) approximation. The circles are the analytical results obtained using the one-step replica symmetry breaking 
(1-RSB) ansatz. In panel (c) the dotted line (clean Ising) is the analytic result for the infinite-range Ising model without disorder. 


circles denote the internal energy per spin U\-rsb/N as ob¬ 
tained using the 1-step replica symmetry breaking (1-RSB) 
approximation (see section V). Specifically, from Eq. (49) and 
Eq. (51), for n = 2 a straightforward calculation gives 

Ui.RSB = -N0( 1 + q 2 0 + 2q 2 (m\ - 1) - 2ggV), (54) 

where <fc>) Sen m i £ R are solutions of the saddle point 
equations (A7)-(A10). Clearly, Eq. (54) implies U\.rsb — f 
Urs for q[ — >• q' 0 , as expected. Moreover, for p « ( 3 C one has 
q[ « q' Q ss 0, implying that U\.rsb ~ Urs, i.e. the effects 
of the replica symmetry breaking are negligible near the crit¬ 
ical point. Interestingly, at low temperatures, where the RS 
approximation fails (see Fig. 6), U\ - rs 11 is in good agreement 
with the Monte Carlo data, at least up to /? « 2. 

VII. THE CLASSICAL RENYI ENTROPIES 

We now turn to discuss the behavior of the classical Renyi 
entropies (cf. Eq. (5)). Here we restrict ourselves to the 
second Renyi entropy [5 2 ], which is obtained in terms of 
the booklet partition function Z{u>,2,(3) (see section II) as 
— \og(Z(uj, 2, 0)/Z(O, 2, p)). Due to the mean-field nature 
of the S-K model (cf. Eq. (7)), there is no well defined bound¬ 
ary between the two parts A and B of the system (unlike in 
local spin models). With this in mind we assume that we will 
find volume law behavior [S 2 ] oc N, and consider the entropy 
per spin [5 2 ]/iV as the quantity of interest. 

The Monte Carlo data for [S^/iV are shown in Fig. 8 plot¬ 
ted versus the inverse temperature 0.25 <P< 2.5. Some de¬ 
tails on the Monte Carlo method used to calculate [S 2 ] are pro¬ 
vided in Appendix C. The different panels correspond to the 
booklet ratios ui = 3/4,1/2,1/4 (see Fig. 1). In all the panels 
the triangles, squares, and rhombi correspond to booklets with 


N = 32, 64,128 spins per sheet. Clearly, finite size effects are 
present, which increase upon lowering the temperature, as ex¬ 
pected. In order to obtain [S' 2 ]/W in the thermodynamic limit 
we fit the data to the ansatz [S 2 ]/iV = s 2 (w) + 
where s 2 (w) is the entropy per spin in the thermodynamic 
limit, c' a constant, and (t> the exponent of the finite-size cor¬ 
rections. The plus symbols in Fig. 8 are the results of the 
fits. We should mention that the fits give </> « 2/3, which is 
the exponent of the scaling corrections of the free energy in 
the standard S-K model. This is not surprising, since [iS 2 ] is 
obtained as the difference [S 2 ] = [F(0,2,P) — F(u, 2,0)] 
(cf. Eq. (5)). Clearly, from Fig. 8 one has that in the ther¬ 
modynamic limit [S 2 ]/N is finite for any 0, confirming the 
expected volume law behavior. Moreover, [.S/j/A' exhibits a 
maximum in the infinite-temperature limit /? —> 0. The height 
of this maximum is a decreasing function of w (compare the 
panels (a)(b)(c) in Fig. 8). 

The dash-dotted line in the Figure denotes the analytical 
result [S^] obtained within the RS approximation (see sec¬ 
tion IV C). More precisely, [.S' 2 K, ‘ > ]/A ? is obtained from Eq. (5) 
and the expression for the free energy [Frs] (cf. Eq. (38)). 
Notice that in the high-temperature limit /?—►(), where the 
RS approximation is exact, Eq. (5) and Eq. (31) give 

= w log(2) - ^oj 2 + O(0 3 ). (55) 

From Fig. 8 one has that the extrapolated MC data are in quan¬ 
titative agreement with [S)f' S ]/7V for p < 1.5, whereas strong 
deviations are observed at lower temperatures (not shown in 
the Figure). A better approximation for [S^J/TV at low tem¬ 
peratures is obtained by including the effects of the replica 
symmetry breaking. The circles in Fig. 8 denote the one-step 
replica symmetry breaking result [S'|‘ ii-SB ]/A r (see section V), 
which is obtained from Eq. (5) and Eq. (49). Remarkably, 
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FIG. 9. The classical disorder-averaged mutual information per spin [X 2 \/N in the S-K model on the 2-sheets booklet: [X 2 ]/N versus the 
inverse temperature /3. The different panels correspond to different booklet ratios uj = 1/2,1/4,1/8 (see Fig. 1). The same scale is used on 
both axes in all panels. The symbols are the Monte Carlo data for systems with N = 32, 64,128 spins per sheet. The Monte Carlo error bars 
are smaller than the symbol size. The dash-dotted line is the analytical result in the replica-symmetric (RS) approximation. In (a) the dotted 
line is the result for the clean, i.e., without disorder, infinite-range Ising model. 


[S 2 ~ rsb ]/N is in excellent agreement with the extrapolated 
Monte Carlo data for /3 < 2. Finally, for comparison we re¬ 
port in panel (c) the analytical result (dotted line) for S 2 /N 
for the infinite-range Ising model without disorder at ui = 1/4 
(see Appendix B). 


VIII. THE CLASSICAL RENYI MUTUAL INFORMATION 


Here we focus on the behavior of the Renyi mutual infor¬ 
mation \X 2 ]. Similar to [£2], the mutual information exhibits 
the volume law [I2] oc N. This is in contrast with local mod¬ 
els, where [I„], for any n, by construction obeys an area law 
at all temperatures. Here we consider the mutual information 
per spin [I 2 ]/N. 

Figure 9 plots [I 2 ]/N versus 0 < /? < 2.5 and w = 
1/2,1/4,1/8 (panels from left to right in the Figure). No¬ 
tice that by definition (cf. Eq. (4)) [Z„(w)] = [Z n (l — w)]. 
Circles, squares, and triangles are Monte Carlo data for 
N = 32,64,128. In the high-temperature region [Z2] ex¬ 
hibits a vanishing behavior. Moreover, finite-size effects are 
“small”. Using Eq. (27) it is straightforward to derive the 
high-temperature behavior of [Z„] as 

NB 2 

[In] = -^-uj(l~tu)n + 0(l3 A ). (56) 

[1 2 ]/N increases upon lowering the temperature up to /? ft 1, 
where it exhibits a maximum. One should stress that its po¬ 
sition is not simply related to the paramagnetic-glassy tran¬ 
sition. Furthermore, the data for [I 2 ]/N at different system 
sizes do not exhibit any crossing. This is in sharp contrast 
with local models 28 , where I n /L exhibits a crossing at a sec¬ 
ond order phase transition. The dash-dotted line in Fig. 9 is 
the analytical result obtained using the replica symmetric (RS) 
approximation (see section IV C). Formally, this is obtained 
using Eq. (4) and Eq. (38), and it is in perfect agreement with 


the MC data in the whole paramagnetic phase. Finally, we 
should stress that similar qualitative behavior is observed for 
I 2 /N in the infinite-range Ising model without disorder. The 
analytical result for I 2 /N at w = 1/2 in the thermodynamic 
limit is reported in panel (a) (dotted line). 

Interestingly, at low temperatures \I 2 \/N exhibits strong 
finite-size corrections, and significant deviations from the RS 
result. In order to extract the thermodynamic behavior of 
[X 2 \/N we fit the MC data to 


\u 

N 


— CL + 


N*’ 


(57) 


where we fix ^ = 2/3. The results of the fits are shown 
in Fig. 10. Different symbols now correspond to different 
aspect ratios uj. Remarkably, the RS approximation (dash- 
dotted lines) is in good agreement with the extrapolations for 
/3 < 0.6. We should stress that in the region 0.6 < /3 < 1, 
i.e., near the peak, due to the large error bars it is difficult to 
reach a conclusion on the validity of the RS approximation. 
In particular, the data exhibit a systematic shift of the mutual 
information peak towards lower temperatures. Much larger 
system sizes would be needed to clarify this issue. The effect 
of the replica symmetry breaking, however, should be negli¬ 
gible. For instance, at /3 = 0.6 for u> = 1/2 one can estimate 
that |[Zf s ] — [I 2 ~ rsb ]\/N ~ 2 • 10 -5 . Moreover, the results 
for the infinite-range clean Ising (see Appendix Bl) suggest 
that logarithmic scaling corrections as oc log (N)/N could be 
present at criticality making the extrapolation to the thermo¬ 
dynamic limit tricky. Finally, clear deviations from the RS 
result occur at lower temperatures. For instance, for u> = 1/8, 
the numerical results exhibit deviations from the RS result al¬ 
ready at £ > 1. These deviations, however, have to be at¬ 
tributed to the physics of the replica symmetry breaking. The 
full rhombi in Fig. 10 denote the one-step replica symmetry 
breaking result \£^~ RSB \, which is obtained using Eq. (4) and 
Eq. (49)). The agreement between and the Monte 

Carlo data is perfect up to (5 < 2. 
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FIG. 10. The classical mutual information per spin [2y/(V in the 
S-K model on the 2-sheets booklet: py/lV plotted versus /3. The 
symbols denote the Monte Carlo results extrapolated to the thermo¬ 
dynamic limit for booklet ratios u> = 1/2,1/4,1/8 (circles, squares, 
triangles). The dash-dotted lines are the analytical results in the 
replica-symmetric (RS) approximation. The full symbols (rhombi) 
are the results in the first-step replica-symmetry-breaking (1-RSB) 
approximation. 


IX. SUMMARY AND CONCLUSIONS 

We investigated the classical Renyi entropy S n and the 
mutual information I n in the Sherrington-Kirkpatrick (S- 
K) model, which is the paradigm model of mean-field spin 
glasses. We focused on the quenched averages [5 n ] and [X n ], 
Specifically, here [5„] and [I„] are obtained from suitable 
combinations of the partition functions of the S-K model on 
the /(-sheets booklet (cf. Fig. 1). This is constructed by “glu¬ 
ing” together n independent replicas (“sheets”) of the model. 
On each replica the spins are divided into two groups A and 
B, containing Na and Nb spins respectively. The spins in 
part A of the different sheets are identified. Due to the mean- 
field nature of the model, physical quantities depend on the 
bipartition only through the aspect ratio oj = Na/N. 

We first discussed the thermodynamic phase diagram of the 
S-K model on the n-sheets booklet, as a function of tempera¬ 
ture, and the aspect ratio ui (cf. Eq. (3)). For any fixed ui the 
S-K model exhibits a low-temperature glassy phase, which is 
divided by the standard paramagnetic one at high tempera¬ 
tures by a phase transition. The critical inverse temperature 
j3 c exhibits a non trivial decreasing behavior as a function of 
u>. Moreover, one has f3 c = 1 and /3 C = 1/2 for ui = 0 
and u> = 1, respectively. In the high-temperature region the 
permutation symmetry among both the replicas and the phys¬ 
ical sheets is preserved. This allowed us to provide an ex¬ 
act analytic expression for the free energy of the model and 
several derived quantities, such as the internal energy. We 
compared our results with Monte Carlo simulations, finding 
perfect agreement. Oppositely, in the low-temperature phase 
the replica symmetry is broken. For instance, we numerically 
observed that the replica-symmetric (RS) result for the inter¬ 
nal energy is systematically lower than the Monte Carlo data, 
as in the standard S-K model' 1,7 . This discrepancy becomes 


larger upon lowering the temperature. 

Inspired by the Parisi scheme 45 , we devised a systematic 
way of breaking the replica symmetry in successive steps. Our 
scheme breaks only the symmetry among the fictitious repli¬ 
cas, preserving that among the physical ones. Although this 
appears natural, we were not able to provide a rigorous proof 
that this is the correct symmetry breaking pattern. As a conse¬ 
quence, our scheme should be regarded as an approximation, 
and not as an exact solution. Moreover, we restricted our¬ 
selves to the one-level replica symmetry breaking (1-RSB). 
Surprisingly, the 1-RSB result for the internal energy are in 
excellent agreement with the Monte Carlo data for /? < 3, 
whereas the RS approximation fails already at (3 ~ 1. This 
suggests that the 1-RSB ansatz captures correctly some as¬ 
pects of the replica symmetry breaking. 

Clear signatures of the replica symmetry breaking can be 
observed in the behavior of [Sy. First, since [<Sy exhibits 
the volume law behavior [Sy oc N, we considered its den¬ 
sity [<Sy/A. For finite-size systems, and for any ui, [Sy/iV 
exhibits a maximum at infinite temperature, and it is a de¬ 
creasing function of the temperature, as expected. Finite- 
size corrections are negligible at high temperatures, whereas 
they increase upon lowering the temperature. In the param¬ 
agnetic phase we were able to determine the functional form 
of [S 2 ]/N in the thermodynamic limit, using the replica- 
symmetric approximation. This perfectly matched the Monte 
Carlo data. At low temperatures deviations from the RS re¬ 
sult are present, reflecting the replica symmetry breaking. Re¬ 
markably, the one-step replica symmetry breaking (1-RSB) 
result [S 2 ~ rsb ]/N fully describes the Monte Carlo data for 
/? < 3, consistent with what was observed for the internal 
energy. 

Finally, we considered the Renyi mutual information py. 
This obeys a volume law for any j3 and u>, in contrast with 
local spin models, where an area law is observed 12 . The 
corresponding density py/lV vanishes in both the infinite- 
temperature and the zero-temperature limits. Surprisingly, 
[1 2 ]/N does not exhibit any crossing for different system sizes 
at the paramagnetic-glassy transition, in striking contrast with 
local spin models 28 . For any ui, [T 2 ]/N exhibits a maximum 
for /3 sa 1. The position of this maximum is not simply related 
to the paramagnetic-glassy transition. At high temperature 
py/iV is described analytically by the RS result [1 2 ] RS /N. 
Deviations from the RS result, if present, are < 10 On 
the other hand, at low temperatures one has to include the ef¬ 
fects of the replica symmetry breaking. Similar to [ 52 ], the 
1-RSB approximation \I\~ RSB ]/N is in good agreement with 
the Monte Carlo data for /3 < 3. 

Our work opens several research directions. First, it would 
be interesting to extend our results taking into account the full 
breaking of the replica symmetry, i.e., going beyond the one- 
step replica symmetry breaking approximation. This would 
allow us to reach a conclusion on the correctness of the replica 
symmetry breaking scheme that we used. Moreover, it would 
be interesting to discuss the finite size-corrections to the sad¬ 
dle point approximation. An intriguing direction would be 
to investigate whether the glassy critical behavior is reflected 
in the volume-law corrections to the classical Renyi entropies 
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and mutual information. Finally, it would be interesting to where we defined Ao(z) as 
extend our results to quantum spin systems exhibiting glassy 
behavior and replica symmetry breaking 5 1 ,52 . 

z 2 1 

Ao(2) - ww ~ W 0 
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and the so-called heat kernel Gq(z) as 


G 0 (z) 


1 

— , exp 

P 2 q'o 


( 



(A4) 


Appendix A: The saddle point equations 

In this section we provide the analytical expression for the 
saddle point equations (22)(23), which determine the overlap 
tensor q^L, (see section IIIB). We restrict ourselves to zero 
magnetic field and to the 2-sheets booklet (see Fig. 1). It is 
straightforward to generalize the calculation to the case with 
non zero magnetic field and to the n-sheets booklet. Here 
we provide the saddle point equations for both the replica- 
symmetric (RS) (see section IV C) and the one-step replica 
symmetry breaking (1-RSB) approximations (see section V). 


Notice that f dzGo(z)A 0 (z) = 0. 

2. The one-step replica symmetry breaking (1-RSB) 
approximation 

In the one-step replica symmetry breaking approxima¬ 
tion (see section V) qJA, depends on the four parameters 
9o, 9m m i ^ The saddle point equations are given as 
Vpfc.xsB] = o, where p = (q 0 , q' Q , q[, mi), and [F^rsb] 
is the disorder-averaged free energy given in Eq. (49). It is 
useful to define the modified heat kernel G\(z) as 


1. The replica-symmetric (RS) approximation 

In the replica-symmetric approximation (fJ, depends on 
the two parameters qo, q' 0 £ K. (cf. Eq. (37)). The saddle point 
equations are derived from the RS approximation for the free 
energy [F RS (w,n,P)] (cf. Eq. (38)) as Vq[F RS (ui, 2, /3)] = 
0, where q = (qo,q'o), and V q = d/dq. A straightforward 
calculation gives 

= 2 J dzG 0 {z)(l + exp(2/3 2 {q 0 -q l 0 ))cosh(2z))~ 1 , 

(Al) 

and 

-i / /* 

2/3 2 -— = / dzGo(z)\ ———A 0 (z) logcosh(2z) 

1 — w J 11 — UJ 

+ A 0 (z) log(l + exp(2 /3 2 (q 0 - q' 0 )) cosli(2z)) 

+ 2/3 2 (l + exp(2 /3 2 (q 0 - q’ 0 )) cosh(2z)) _1 1, (A2) 


Gi(z) = 


V 2w ^ 2 (li -9o) 


exp 


2 


(A5) 


and 


A () — 2,2 ^ 

l[z) = WiqWqW^qW7 0 

T{z) = {J dz'Gi(z') cosh mi (2z + 2z') j 


(A 6 ) 


r'(z) = | J dz'Gi(z') ^1 + cosh( 2 z + 2z')'j | 

0 (x, z') = 1 + exp(2/3 2 (qo — q[)) cosh( 2 z + 2 z'). 


Finally, the saddle point equations for qo, < 7 o, Qii mi are ob¬ 
tained as 


0 = (1 + qo — 2w) exp(— 2/3 2 (q 0 — q[)) — 2(1 — oj) / dzdz'Go{z)T'(z)Gi(z') cosh(2z + 2z')0 mi 1 (z, z') (Al) 
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0 = 4/3 2 mi9o + —J dzGo(z)A 0 (z) log J dz'Gi(z') cosh mi (2z + 2z') 

H- f dzGo(z)A(z) log f dz'Gi(z')Q mi (z,z') - [ dzdz , Go(z)r(z)Gi(z , )Ai(z , )cosh Tni (2z + 2z') 

mi J J mi J 

[dzdz'Go(z)r'(z)G 1 (z')A 1 (z')e mi (z,z') (A8) 

m i J 

0 = —4/3 2 (mi — 1 )q[ — 4 /3 2 uj + — [ dzdz'Go(z)T(z)Gi(z , )Ai(z') cosh mi ( 2 z + 2 z') 

mi J 

+ -—— J dzdz'Gn{z)T’{z)Gi{z')^y Ai(z')Q mi (z, z') — 4/3 2 toi exp(2/3 2 (go — <Zi)) cosh(2z + 2z , )Q mi ~ 1 (z, z')j (A9) 


0 = 


— Qn) + —— f dzdz'G 0 (z)T(z)Gi(z') cosh mi (2z + 2 z') logcosli( 22 : + 2z') 
mi J 

dzdz'Go(z)T , (z)Gi(z')Q Tni (z,z , )log(Q(z,z'))— ^ J dzGo(z)log J dz'Gi(z')Q rni (z,z') 

— —2 J dzGo(z)log J dz'Gi(z') cosh mi ( 2 z + 2z'). (A 10 ) 


1 — UJ 
mi 


Appendix B: Mutual information in the infinite-range clean 
Ising model 

Here we discuss the Renyi entropy S 2 and the associated 
mutual information Z 2 in the infinite-range Ising model with¬ 
out disorder, defined by the hamiltonian 

n = ~Y t s i s j + h Y t Si- fBi) 

i<j i 

We consider the situation without external magnetic field, i.e., 
h = 0 and fix J = 1. The phase diagram of the model ex¬ 
hibits a paramagnetic phase at high temperature, while at low 
temperatures there is ferromagnetic order. The two phases 
are separated by a phase transition at p c = 1. We consider 
both the situations with finite N as well as the thermodynamic 
limit. For finite N we provide exact numerical results for ,S ' 2 
and I 2 , while we address the thermodynamic limit using the 
booklet construction (see II) and the saddle point approxima¬ 
tion. 

Similar to the S-K model, we find that the para-ferro transi¬ 
tion persists on the booklet, and the critical temperature de¬ 
pends on the booklet ratio oj. The Renyi entropy ,S ' 2 and 
the mutual information I 2 are extensive, and their densities 
S 2 /(V) X 2 /N finite and smooth at any temperature. Notice 
that this different for the Shannon mutual information 46 X\, 
which is finite (i.e., Xi ~ 0(1)) in the whole phase diagram, 
except for a logarithmically divergent behavior (with system 
size) at the critical point (3 C = 1 . 

Finally, we show that the information about the phase tran¬ 
sition is encoded in the subleading, i.e. o(N), corrections 
of X 2 . Precisely, logarithmically divergent contributions are 
present at /3 = 1 / 2,1 and /3 = p c (u>), with ft c (u>) the critical 
temperature of the model on the booklet at fixed aspect ratio 


1. Saddle point approximation 


We first discuss the thermodynamic limit. The calculation 
of the booklet partition function Z(ui,n,p) (see section II) 
can be done using the same techniques as in section III. The 
result reads 


Z(u,n, p) = exp ( - ^nj " j \\_dzg exp N j 

J 6 

2 

^ —( 1 —w)log (2 cosh zg) +u log( 2 coshy^^)|, 


(B2) 


with S = 1 ,,n. Using the saddle point approximation, 
from (B2) one obtains F(oj, n, 0) = log Z(uj, n, 0) as 


2 

F{w, n, P) « N | - ~ (1 - w ) lo g ( 2 cosh z s) 

+ 1 j log (2 cosh zs )}, (B3) 

s 

where we neglected subleading contributions o(N). The pa¬ 
rameters { 2,5 }/ = l are solutions of the saddle point equations 

0 = zg — P( 1 — u>) tanh zg — Poj tanh (E Z S ), V<5. (B4) 

s 

For n = 2, the system (B4) becomes 

0 = Zi — P(1 — w) tanh z\ — /3utanh (zi + z 2 ) (B5) 
0 = z 2 — P(1 — w) tanh z 2 — (3oj tanh (zi + z 2 ) ■ (B 6 ) 
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FIG. 11. The infinite-range Ising model on the 2-sheets booklet: 
saddle point approximation. The solution z a of the saddle point equa¬ 
tions (B4) plotted as a function of the inverse temperature /3 and for 
booklet aspect ratio uj = 0,1/2,1. The vertical dotted line denotes 
the critical inverse temperature forui = 1/2. 


The system has the solutions Z\ = z 2 = z s = 0 for /3 < (3 C = 
1/(1 + w), and z\ = z 2 = z s ^ 0 for (3 > (3 C . Note that f3 c is 
different in presence of disorder (see (44)). 

The solution z s of the saddle point equations (B4) is shown 
in Fig. 11 as a function of /3 for u = 0,1/2,1. The vertical- 
dotted line is f3 c for ui = 1/2. Notice that at low temperatures 
z s is independent on lu, and one has z s ~ B. 


2. Renyi entropy and mutual information: saddle point results 

It is straightforward to obtain the Renyi entropies S n = 
(F(uj = 0,n,/3) — F(oj,n, f3))/(n — 1) using (B3) and (5). 
Figure 12 plots the entropy density S 2 /N versus the inverse 
temperature f3. S 2 exhibits a volume-law behavior S 2 oc N 
for all values of (3 and u>. The different curves correspond to 
different booklet aspect ratios oj. For f3 < /3 C one has the flat 
behavior S 2 = w log(2), whereas S 2 is vanishing in the low- 
temperature regime. The full symbol (rhombi) in Figure 12 
are exact results for a booklet with N = 400 spins per sheet 
(see next section), and are in good agreement with the saddle 
point approximation results. 

The mutual information per spin I 2 /N is reported in Fig¬ 
ure 13. The lines are the analytical results for booklet as¬ 
pect ratios u> = 1/20,1/4,1/2, while the full symbols are the 
exact results for the booklet with TV = 400 spins per sheet. 
Clearly, X 2 /TV is exactly zero in the high-temperature region 
for [3 < 1/2, it exhibits at maximum at ;3 ~ 1, and it is van¬ 
ishing in the limit [3 —» 00. 

Finally, one should stress that a dramatically different be¬ 
havior is observed in the Shannon mutual information I\ = 
liin„^i X„. Specifically, I\ is finite in the thermodynamic 
limit, and it only exhibits a logarithmic divergence as I = 
l/41og(7V) at the critical point f3 c = 1 (see Ref. 46). 



P 


FIG. 12. The infinite-range Ising model on the 2-sheets book¬ 
let in the thermodynamic limit: the classical Renyi entropy density 
S 2 /N, with N the total number of spins on a single sheet of the 
booklet. S 2 /N is plotted against the inverse temperature (3 and for 
booklet aspect ratio u> = 1/4,1/2,1. Note tht at high temperature 
S 2 = lo log(2). The lines are obtained using the saddle point approx¬ 
imation, while the full symbols denote the exact numerical results for 
a finite system with N = 400. 



FIG. 13. The infinite-range Ising model on the 2-sheets booklet in 
the thermodynamic limit: the classical mutual information density 
T 2 /N plotted against the inverse temperature /3 and for booklet as¬ 
pect ratio u) = 1/4,1/2,1. Note that I 2 = 0 for /3 < 1/2. The full 
symbols are the the exact numerical results for a finite system with 
N = 400. 


3. Renyi entropy and mutual information: Exact treatment 

For finite N, S 2 and I 2 can be calculated exactly using the 
results obtained in Ref. 46. The eigenstates of (Bl) are prod¬ 
uct states. They can be characterized as |p, i), with p the total 
number of up spins (the remaining TV — p being down spins) 
and i labelling the B(N,p) = N\/(p\(N — p)\) eigenstates 
with the same p. The partition function of (Bl) is given as 

N 

Z(/3) = Tr j o = ^B(TV,p)e 2Ar/3 ( w-5) 2 . (B7) 

p —0 
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Similarly, one has 

N 

Z n (P) = Tr^]B(iV,p)e 2nAr/3( ^"5 )2 . (B8) 

p—0 

The thermal density matrix p is defined as p = 1 /Z(r :lH . 
Given a bipartition of the spins into two groups A and B con¬ 
taining N A and N — Na spins, respectively, the reduced den¬ 
sity matrix for A is obtained as 46 

Pa = ^Tr B ^2e 2N0< '^~^' >2 \p,i)(p,i\- (B9) 

p,i 



P 


By performing the trace over part B one obtains 

PA=Y R{PA)\pA,lA){pA,iA\ , (BIO) 

PA,iA 


where \p A , i A ) form a basis for part A of the system and 

, n-n a 

R{pa)= £ Y B(N-N A:PB )e 2N ^ + ^-^ 2 . 

Pb—O 

(Bll) 

From (BIO) it is straightforward to obtain 

Na 

Tvp n A = Y B(N AlPA )R n ( PA ). (B12) 

PA = 0 

Similarly, Trp^ is obtained from (B12) substituting A -A B 
and N a -a N — N A , while Trp^ 4 UB = Tr p n . The Renyi 
entropies S n and the mutual informations l n can be calculated 
numerically using (B12), (B 8 ) and the definitions (2) (4). The 
numerical results for S 2 and X 2 for a system with N = 400 
spins are shown in Figure 12 and Figure 13, and are in good 
agreement with the results in the thermodynamic limit. 

Figure 14 focuses on the finite-size subextensive correc¬ 
tions for Z 2 . We plot Z 2 — z!f PI , with z!/ pl denoting the 
saddle point extensive part of Z 2 . We restrict ourselves to 
w = N a /N = 1/2, although similar results have to be ex¬ 
pected at different w. Clearly, X 2 — Ip' ! is vanishing at high 
temperatures, whereas one has Z 2 — Zp p> -a log( 2 ) in the 
limit /3 — >- 00 (horizontal line). Surprisingly, Z 2 — Zp p) di¬ 
verges in the thermodynamic limit for/3 = 1/2,2/3,1 (ver¬ 
tical lines in the Figure), which are the critical temperatures 
for the model on a booklet with w = 1,1/2,0. This di¬ 
vergence is logarithmic as a function of TV, as confirmed 
in Figure 15 plotting |I 2 — X 2 sp) | versus log(TV) for fixed 
/3 = 1/2, 2/3,1. Interestingly, the precise behavior depends 
on /3. One has |X 2 — X 2 spl | oc l/41og(lV) for /3 = 1/2 and 

|I 2 — Zp ' 1 1 a l/21og(TV) for = 2/3 and [3 = 1. Again, 
this is dramatically different for the von Neumann mutual in¬ 
formation Zi = lining! Z n , which exhibits only one divergent 
peak 46 at /3 = 1 . 


FIG. 14. The infinite-range Ising model on the 2-sheets booklet: 
saddle point corrections. The correction for the mutual information 
X 2 — are plotted against the inverse temperature /3. The data 
are for a booklet with aspect ratio 10 = 1/2. Here Zp' 1 are the 
same data as in Figure 13 (dotted line). The vertical lines denote 
the critical temperatures /3 C for w = 1,1/2, 0 (from left to right). 
The horizontal dash-dotted line is log(2). Note the (logarithmically) 
divergent behavior at (3 C . 



FIG. 15. The infinite-range Ising model on the 2-sheets booklet: 
Scaling of the corrections of the mutual information I 2 at the booklet 
critical points /3 C = 1/2, 2/3,1 (see vertical lines in Figure 14). We 
plot IX 2 — Tp ' 1 1 versus log(TV), with N the number of spins on one 
sheet of the booklet. Here Tp' > is the same as in Figure 13 (dotted 
line). 


Appendix C: Monte Carlo method to calculate the classical 
Renyi entropies 


Here we describe the Monte Carlo method that we used to 
calculate the Renyi entropies S n and the mutual information 
Z n . The method exploits the representation of S n as ratio of 
partition functions as 


Sn(A) = 


1 

1 — n 


log 


f Z(A,n,P)\ 

\ z n (P) )' 


(Cl) 


where Z(A, n, /?) and Z{/ 3) are the partition functions of the 
model on the booklet and on the plane, respectively (see Fig. 1 
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and section II for the definitions). There are only few ap¬ 
proaches to numerically calculate the ratio of partition func¬ 
tions in Eq. (Cl). For instance, a brute force numerical inte¬ 
gration of the internal energy as a function of temperature 28 
can be used to calculate Z(A, n, /3) and Z(j3). However, this 
requires high accuracy over a large range of temperature. 

Here we directly measure the ratio of partition functions 
using the so-called ratio trick. In the ratio trick one splits the 
subsystem A in a set of subsystems Ai such that Ai C A i+ i, 
and the largest subsystem in the set is simply A itself. Then 
one writes 

Z(A,n,p) _ N ^ 7 1 Z(Ai, n, (3) 

Z n {P) Z(A i+1 ,n,py 1 3 > 


1. Do a full Monte Carlo sweep of the system on the book¬ 
let with A = Ai to generate an importance sampled 
spin configuration. This can be done with any update 
scheme, such as standard Metropolis or cluster updates. 

2. For the spins living in the set difference A, +1 \ Ai cal¬ 
culate 

Wa= nE e_/3B ‘"- (C5 > 

n i n 

Here (cf. Eq. (C3)) i runs over all the 2 4 5 6 7 8 9 10 11 configurations 
of the four spins in Ai + 1 \ A, for each of the n sheets, 
and E in is the energy associated with the spin configu¬ 
ration i n on a single sheet. 


where for simplicity we specialized to intervals A, such that 


3. Calculate the quantity 


Ai = U, i G [0, 1V/4]. (C3) 

Crucially, if the length of A,, increases mildly with i, each 
term in the product in the right-hand side of Eq. (C2) can be 
sampled efficiently in Monte Carlo 29 . Notice that the same 
trick has also been used in Ref. 53-55. More specifically, one 
can write 


W b = Y^ e-~ PEj ■ (C6) 

3 

As in step 2, j runs over all the 2 4 configurations of 
the four spins living in \ Ai, but since the spins 
living on different sheets are identified there are only 2 4 
configurations in total and the energy £) is that of all n 
sheets together. 


Z(Ai,n,P) = Tj^j 
Z(A it n,P) IW/ 

where is the (Monte Carlo) transition probability from a 
spin configuration living on the booklet with subregion A = 
Ai to a spin configuration living on the booklet with A = Aj. 
Notice that spins in region A of different sheets are identified 
(cf. Eq. (8)). Clearly, if j < i one has T^j = 1. When j > i 
a naive method to determine would be to simply count 
the fraction of times (during the Monte Carlo update) that a 
spin configuration living on the booklet with A = Ai is also 
a valid spin configuration on the booklet with A = Aj. In 
the following we provide a more efficient scheme to calculate 
Ti^j- To summarize, our approach for calculating the ratio of 
partition functions in Eq. (C2) consists of four steps: 


4. Calculate the transition probability as 


= /Wl\ 

l_H+1 \wj 


(Cl) 


where the angular brackets denote the Monte Carlo average. 
This method is much faster than simply counting configura¬ 
tions as it allows us to integrate over all possible configura¬ 
tions of the spins in Ai + 1 \ ,4,, treating the remaining ones 
as a bath that is updated by the regular Monte Carlo update. 
The computational cost of this procedure grows exponentially 
with the number of spins in A i+ i \ A, . In our Monte Carlo 
simulations we calculate Z(Ai,n, 0)/Z(Ai+\,n, (3) for ev¬ 
ery disorder realization and S n (A) using Eq. (Cl). Finally, 
we average over the disorder to obtain [S n (A)]. 
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